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Contact  with 
has  indicated  the 
pressing,  yet  the 
concerning  the  pr 


cone  1'achine  Simulation  llodels  (war  games) 
t  the  need  for  "random  numbers"  is  real  and 
information  available  to  the  war  gamers 
operties  of  these  numbers  is  often  quite 


vague  and  limited. 

The  average  of  the  results  of  several  runs  of  a  war  game 
is  often  used  to  evaluate  the  many  relationships  tested  by 
the  game.  Since  random  numbers  are  the  device  that  determine 
the  yes/no  answer  at  the  many  decision  poirits  of  the  game, 
the  faithfulness  with  which  these  numbers  exhibit  the  proper¬ 
ties  desired  by  the  war  gamer  directly  affect  the  validity  of 
the  results. 


In  view  of  the  critical  role  in  war  gaming  played  by 
these  numbers  it  seems  useful  to  provide  a  tested  method  of 
producing  the  numbers,  and  to  provide  also  the  means  of  test¬ 
ing  any  other  number-producing  methods  considered  useful. 

Random  numbers  have  an  important  application  in  statis¬ 


tical  sampling,  war  gaming,  and  other  monte  carlo  techniques. 
The  applications  mentioned  in  this  paper  will  be  primarily  in 


:he  war  game  area. 

This  thesis  was  written  at  the  United  States  have.  1  Tost- 


durins  the  Deriod 


graduate  School,  Uonterey,  California, 


danuar y-”a  ,  .  I  r.r.  i  nd*;hf  eb  to  *  rofessor  ’ac1*  r. . 

fore for  Ms  encoura •••  .'••~en t  mb  capable  guidance  while 
acting  as  faculty  ah'*  ■  or,  a *i 1  to  !  ro feasor  Thomas 
Cbc",h>,c1  for  his  valuable  assistance  as  second  rearer.  I 
vis’'  to  tharh  t’-w>  '-’aval  I’ortgrednate  'School  Computer  Center 
staff  for  their  patience  r.n>1  efficiency  in  accepting  and 
processing  a  multitude  of  programs  compiled  during  the  writ 
in?  of  this  thesis. 

This  thesis  was  'written  irimarily  for  the  reader  with 
bach ground  in  calc  ll  is  and  statistics,  but  may  be  useful  to 
anyone  with  a  basic  ’-novledge  of  the  use  of  computers  for 


war 


The  U.  T .  -;:vy  has  procure'1  high  s^eed  digital  computers 
and  ad .. pted  automatic  data  processing  AVN)  to  nc-ct  the  t'e- 
naru's  of  the  increasing  complexities  •  e  modern  warfare  and 
weapon  r«>  stems .  In  particular,  such  computers  and  i’ll  find 
ay  plication  in  the  Naval  Tactical  Tate  ‘"hasten  and  in  Command 
an-1  Control  Tenters  which  h,  ve  been  set  up  to  provide  -■ effec¬ 
tive  direction  of  military  forces.  These  military  activities, 
with  automatic  data  processing  capability,  also  have  a  poten¬ 
tial  capability  for  war  pausing  an  1  machine  r. i uvula ti on  with 
the  corvputers .  ! Ian}’  activities  are  engaged  in  the  writing, 

playing  an.'1  evaluation  of  war  awes  at  this  time.  It  seems 
lively  that  war  .gaming  will  soon  become  or.e  of  the  routine 
functions  of  the  commands  with  ATVrs  capability. 

To  assist  in  meeting  the  educational  requirements  of  this 
situation,  formal  instruction  in  war  gaming  u-ing  digital  com¬ 
puters  is  under  development  at  the  U.C.  Naval  Academy  and  tl,e 
U.  ^ .  Naval  Postgraduate  "chool.  Fleet  Fropramrning  Center:, 
have  been  established  for  direct  support  of  activities  employ¬ 
ing  automatic  data  processing  and  conducting  machine  simula¬ 
tion  war  games. 

Through  the  formal  instruction  in  war  gaming  at  the  N.~. 


Nas  al  "'ostgra  hate  School  it  ha;r  become  ac or. rent  tVrt 


are  none  initial  problem"  in  ^hc  study  of  war  gaming.  One 
problem  lies  ir.  I  aving  precise  terminology  and  notation  to 
explain  concepts  that  are  largely  probabilistic  in  nature. 
Another  lies  in  the  stochastic  structure  of  the  game,  i.e., 
the  decision  points  in  the  game  which  require  drawing  a  ran¬ 
dom  number  to  determine  the  occurrence  or  non-occurrence  of 
an  event.  This  provides  the  requirement  for  a  random  number 
generator  in  the  game.  A  third  problem  is,  given  a  random 
number  generator,  are  the  characteristics  of  the  numbers  pro¬ 
duced  by  this  generator  such  that  the  results  of  the  game  are 
valid? 

The  second,  and  third  problem  areas  mentioned,  that  is, 
generation  of  random  numbers,  and  testing  of  random  numbers 
are  the  subject  of  the  investigation  in  this  thesis.  The 
investigation  included  a  search  of  the  literature  and  accu¬ 
mulation  of  reference  material,  writing  CDC  1604  FCTTTAN  pro¬ 
grams  for  generation  of  random  normal,  exponential  and  chi- 
square  numbers,  writing  programs  for  tests  of  random  numbers, 
and  running  the  programs  for  the  generators  and  tests  on  the 
Tt*C  1604  computer. 

Sections  1  and  2  of  the  thesis  contain  discussions  of 
generation  of  random  numbers  and  testing  of  random  numbers, 
respectively.  Section  3  contains  the  results  of  tests  per- 
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formed  on  two  normal  random  number  generators,  an  exponen¬ 
tial  and  a  chi-square  random  number  generator.  Section  4 
presents  the  conclusions  reached  In  this  paper.  Appendices 
A,  B  and  C  provide  justification  for  the  methods  of  genera¬ 
tion  of  random  numbers  and  Appendix  D  reproduces  the  pro¬ 
grams  in  CDC  1604  FORTRAN  language  for  the  four  generators. 

It  is  suggested  that  the  reader  familiarize  himself  with 
the  explanation  of  notation  and  definitions  of  terms  immediate¬ 
ly  following  this  introduction.  It  is  also  suggested  that  the 
U.S.  Naval  Postgraduate  School  thesis  "R.andom  Number  Genera¬ 


tion  on  Digital  Computers by  J.  Barron 


be  consulted 


for  information  concerning  the  generation  of  uniform  random 


numbers . 


DEFINITIONS  OF  TERMS  AND  NOTATION 
In  this  paper  a  random  variable,  X,  and  its  associated 
cumulative  distribution  function  F,  will  be  identified  as 
(X,F)  or,  in  some  instances,  where  it  is  more  convenient  to 
refer  to  the  associated  density  function  f,  we  shall  write 
(X,f).  In  conformity  with  standard  notation 

F(x)  =  pr(X  = x) 

f(x)  = 

dx 

Random  Numbers:  It  is  considered  that  there  is  available 
some  formula  or  mechanism  or  device  v;hich  produces  numbers 
which  are  regarded  as  drawn  from  a  ponulation  (X,F)  or  equi¬ 
valently  (X,  f) .  Such  a  number  is  frequently  identified  as  a 
pseudo-random  number  in  the  literature;  however,  here  we  shall 
identify  it  simply  as  a  random  number. 

V.’e  may  say  that  a  set  of  such  random  numbers  is  associ¬ 
ated  w7ith  the  random  variable  O' ,  F)  or,  more  briefly,  that 
they  are  associated  with  the  distribution  F. 

Senuence  of  random  numbers:  As  the  formula  or  the  generating 
device  or  mechanism  employed  produces  a  set  of  random  numbers, 
these  appear  serially  or  sequentially.  V-e  shall  refer  to 
these  numbers  as  a  sequence  of  random  numbers. 


In  referring  to  random  numbers,  as  defined  above,  as- 


sociated  with  specific  random  variables  and  their  associated 


cumulative  distribution  functions,  we  shall  need  additional 
specific  definitions  and  notation. 

A  normal  distribution  with  mean  /LL  and  standard 
deviation  U  as  parameters. 

U(aT b) :  A  uniform  distribution  over  the  interval  fa,bj  . 

Tn  particular,  u(0,l)  will  be  used  extensively.  ■ 

Random  N(  /i.  t  fT)  number:  A  random  number  associated  with  the 
random  variable  (N,F)  where  F  is  N (// ,  u) . 

Random  TJ(0 . 1 )  number :  A  random  number  associated  with  the 
random  variable  (N,F)  where  F  is  U(0,1). 

Normal  deviate:  A  random  N(0,1)  number  which  has  been  obtained 
as  a  transformation  of  a  random  TJ(0,1)  number. 

Generator:  A  formula  or  method  for  producing  a  seauence  of 

—  I,  —i .  — 

numbers . 

NORMGFN:  The  computer  program  to  generate  normal  deviates 
by  the  Box -Muller  method. 

NOR!  IT  N :  The  computer  program  to  generate  normal  deviates 
by  the  "sums  of  uniforms"  method. 

ERRQGEN ;  The  computet*  program  employing  Marsaglia's  method 
to  generate  exponential  random  numbers. 

CHI GEN :  The  computer  program  to  generate  chi-square  random 


numbers  from  sums  of  squares  of  independent  normal  deviates, 


with  the  number  of  degrees  of  freedom  as  an  arbitrary- 
parameter . 


i’. 


SECTION  1 


1.1  C  THEORY 


For  generation  of  random  numbers  associated  with  general 
random  variables  (X,F)  from  random  U(0,l)  numbers,  it  is  nec- 
cessary  to  establish  a  relation  between  the  uniform  distribu¬ 
tion  and  other  distributions.  Particularly  a  relation  between 
the  uniform  and  normal  distributions  would  be  useful,  because 
other  distributions  such  as  the  chi-square,  F,  and  Student’s 
t  can  be  derived  from  the  normal  distribution.  A  general  re¬ 
lation  between  the  uniform  distribution  and  other  distribu¬ 
tions  does  exist  and  is  called  the  probability  integral  trans¬ 
formation.  This  relation  may  be  stated  as  follows:  (See  [8 
for  a  proof) 

Theorem :  Let  X  be  a  continuous  random  variable 

with  distribution  function  G.  Then  the  random 
variable  Y  =  G(X)  has  a  density  function  given  by 


1  05y?l 


f(y) 


elsewhere ; 


its  distribution  function  is  given  by 


(  0  yfO 


(  y  0  <  y  «=  1 


1  ySl 


1 


The  relation  y  =  G(x)  ip  called  the  probability  integral 
transformation,  and  since  G  is  a  non-decreasing  function  it 
follows  that  (see  page  313  of  -lfj): 


:  r 


G“1(Y)  =  x] 


Pr 


=  G(x)  ]  =  G(x). 


The  above  provides  the  basis  for  generating  random  num¬ 
bers  associated  with  an  arbitrary  distribution  by  transform¬ 
ing  U(0,1)  numbers. 

In  the  case  of  the  exponential  distribution  where 
y  =  G(x).  =  1  -  e  ,  it  is  possible  to  solve  explicitly  for  x, 
that  is,  x  =  -log^Cl-y)  =0.  In  this  case  we  say  that  G  has 
been  found  in  closed  form,  meaning  that  x  has  been  expressed 
in  terms  of  the  logarithm  function,  one  of  the  functions 
which,  like  the  sine  and  cosine,  we  choose  to  call  elementary 
functions . 

For  a  general  distribution  function,  it  is  not  always 
possible  to  find  the  inverse  function  in  closed  form,  that  is, 
it  is  not  always  possible  to  express  the  inverse  in  terms  of 
so-called  elementary  functions. 

For  the  normal  distribution,  a  closed  form  expression 
for  the  inverse*  function  is  not  available.  In  such  a  case 
it  may  be  possible  to  employ  a  graphical  interpretation. 
Graphical  methods,  however,  have  a  minimum  of  decimal  place 


accuracy  and  Lead  to  table  look-up  procedures  in  high  speed 
digital  computers.  Entering  the  ordinate  of  Figure  1  to  de¬ 
termine  abscissa  values  by  use  of  a  table,  sometimes  called 
the  "Normal  Curve  of  Crror  Table",  also  leads  to  table  look¬ 
up  methods  in  the  computer. 

d  ■  v) 


;/  * 

F igure  1 

The  disadvantage  of  the  table  look-up  method  of  supplying 
random  numbers  for  a  war  game  is  apparent  when  the  memory 
space  limitation  of  a  computer  is  considered. 

Cven  though  no  inverse  function  may  exist  in  closed 
form,  it  is  possible  to  construct  generating  schemes  that  are 
fast  and  have  acceptable  properties.  Two  such  generating 
schemes  for  the  tiormal  distribution  are  given  in  the  next 
two  sections. 

Normal  Numbers  by  the  Box-Muller  Method  (NCPMGNN) 

Box  and  Muller  [l]  oroposed  a  method  for  generating  a 


1.2 


pa i r  of  independent  random  N(0,i)  numbers  from  a  nair  of  ran 
r’on  U(0,1)  numbers.  The  transformation  (see  Appendix  A)  for 
generating  the  pairs  of  NT(0,1)  numbers  is: 

i, 

X  -  (-2  log  U  )  ^  Cos  2 77U 

-  1  “el  2 

t 

X  =  (-2  log  U  )  '  Sin  2  7TU 


where 


'  TJ 

1’  2 


are  independent  ’2(0,1)  and  X  ,X  ace  indepen¬ 


dent  N(0,l). 

In  view  of  the  four  functions  (sine,  cosine,  log^, 
square  root)  which  must  be  computed  in  the  3ox-Muller  method 
this  method  cannot  be  considered  fast,  although  a  nair  of 
numbers  is  produced  so  that  computation  time  must  be  halved 
for  comparison  with  other  methods.  The  major  advantage  of 
the  Box -Muller  method  is  that  it  is  an  analytically  exact 
transformation  (of  pairs  of  nurbers)  from  the  uniform  distri 
button  and  will  faithfully  produce  a  normal  distribution 
given  a  uniform  distribution. 


One  disadvantage ,  other  than  computation  time,  is  that 
the  Box-Muller  method  will  reflect  whatever  bias  or  contam¬ 
ination  is  present  in  the  uniform  generator. 

Then  written  as  a  subroutine  and  included  in  a  service 
library,  the  3o> -Muller  normal  generator  may  be  employed  in 


two  ways :  The  pair  of  N(0, 1)  numbers  may  be  delivered  simul¬ 
taneously.  X  in  the  A -re lister  and  X  in  the  '-register,  or 
1  2 

the  subroutine  nay  rave  X  until  the  next  call  for  a  random 
number.  In  the  first  instance  the  user  would  be  required  to 
save  X,  for  any  case  where  only  a  single  number  were  desired. 

In  general,  standard  library  subroutines  are  very  expen¬ 
sive  in  machine  time,  as  they  are  required  to  be  able  to  ac¬ 
cept  the  general  case ...... .they  must  test  for  sign  and  mag¬ 
nitude  in  many  cases  before  beginning  the  computation.  In 


special  cases  where  the  argument  with  which  the  subroutine  is 
entered  is  0=  '=1,  or  perhaps  C  =  X  =  27T,  the  tests  are  not 
germane  and  precious  machine  time  is  wasted.  In  cases  such 
as  this  the  functional  subroutines  can  be  rewritten  and 
shortened  and  included  as  part  of  the  generator  subroutine, 
however  there  is  trade-off  here,  as  this  greatly  increases 
the  length  of  the  generator  and  consequently  the  library  pro¬ 
gram.  The  library  function  routines  arc  then  partially  dupli¬ 
cated  within  the  generator  routine  when  the  generator  routine 
becomes  part  of  the  library.  Of  the  four  generators  described 
in  this  thesis,  these  remarks  pertain  almost  exclusively  to 
the  V:  and  ''uller  X0T' [GTN. 


1.3  Normal  Numbers  from  luns  of  Uniforms  (NCinSUN) 

\  discussion  of  the  justification  for  approximation  of 
a  normal  (0,1)  random  number  by  the  sum  of  12  uniform  (0,1) 
random  numbers  appears  in  Appendix  A.  The  approximation  can 
be  improved  by  increasing  the  number  of  uniform  (0,1)  num¬ 
bers  used,  but  machine  time  places  a  restriction  on  the  de¬ 
sirability  of  using  more  numbers.  The  sums  of  uniform  random 
variables  converge  more  rapidly  to  a  normal  distribution  than 
the  sums  of  random  variables  from  a  non-synmetric  distribution. 
The  program  for  generating  these  numbers  is  short,  in  both 
program  steps  and  machine  time.  There  are  no  library  sub¬ 
routines  which  must  be  called  in. 

This  method  is  appealing  to  the  intuition  as  there  is 
the  factor  of  "smoothing’'  or  averaging  whatever.*  bias  or  con- 
tamination  may  be  present;  in  the  uniform  (0,1)  generator. 


1.4 


Exponential 


Narsaglia ' s 


land on  Numbers  ( EXPO GEN) 

2'  method  for  generating  exponential 


ran¬ 


dom  numbers  is  more  complicated  in  orogramming  details  than 
either  the  NOEMGEN  or  NOTISUU,  but  lends  itself  very  well  to 


the  EG 1TEAN  language . 

The  exnected  value  of  the  n  of  Marsaglia's  method  (see 
Appendix  B)  is  approximately  1.53,  so  on  the  average  only 


1.50  U(0,1)  numbers  are  require*'!  from  which  the  minimum  must 
be  selectee ,  anri  1.3a  discriminations  (see  Appendix  B)  are 
required  to  assign  a  value  to  n.  Assigning  a  value  to  n  also 
requires  an  average  of  1 . 53  discriminations .  Generation  of 
an  cxnonential  number  thus  requires  an  average  of  approxi¬ 
mately  4.75  U(0,1)  numbers. 

This  method  of  producing  exponential  random  numbers  is 
sensitive  to  any  bias  in  the  characteristics  of  the  uniform 
generator . 

1.5  Chi-Seuare  Random  Numbers  (ORIGAN) 

Suppose  that  ten  chi-square  random  numbers  with  five 
degrees  of  freedom  are  desired  and  that  the  NCR!  TUI!  genera¬ 
tor  is  us  o'1  to  produce  the  normal  numbers.  It  takes  12  uni¬ 
form  numbers  to  produce  one  normal  number  and  five  normal 
numbers  to  produce  one  chi. -square  number  wit! «  five  degrees 
of  freedom.  Thus  we  require  50  normal  numbers  and  600  uni¬ 
form  numbers  to  produce  ten  chi-snuare  numbers  with  a  rela- 
fciveiy  small  number  of  decrees  of  freedom.  Ore  has  no  diffi¬ 
culty  seeing  that  production  of  chi-square  numbers  is  expen¬ 
sive  in  machine  time,  however,  in  war  gaming  the  need  for 
chi-s.cuare  numbers  is  likely  to  be  considerably  less  than 
the  need  for  uniform  or  normal  numbers. 
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The  chi-'-  ’uc  ee  *  no  re  tor  ’-'rogram  is  a  5a  in  relatively 
direct  one’  no  special  difficulties  ore  encountered.  The 
frequency  and  goodness -of -fit  tests  do  present  a  special 
problem,  as  changing  the  degrees  of  freedom  in  effect  creates 
a  new  distribution  an'  the  class  intervals  and  expected  fre¬ 
quencies  of  occurrence  within  the  class  intervals  change. 

They  do  not  change  in  such  a  fashion  that  DO-LOCTI  may  be 
most  economically  employed.  The  program  becomes  suite  lengthy 
in  machine  time  if  chi-square  numbers  with  several  different 
degrees  of  freedom  are  tested. 


i  .6  Computer  Language 


FG  ITdAlT  was  the  computer  language  employed  for  all  uro¬ 
grams  written  for  this  thesis.  It  is  realized  that  FORTRAN 
may  not  be  the  best  language  for  all  types  of  war  games,  al¬ 
though  successful  war  games  have  been  written  in  this  lan¬ 


guage.  "peed  and  memory  space  limitations  may  dictate  the 
use  of  assembly  routines  as  opposed  to  FORTRAN - type  comnilers. 
However,  within  a  program,  strings  of  symbolic  machine 

language  may  be  inserted  where  the  legal  FORTRAN  statements 
are  not  appropriate.  In  general,  the  particular  character 
of  the  simulation  will  suggest  ;he  most  convenient  language. 

For  use  in  a  war  game,  the  four  random  number  generators 
in  this  thesis  must  be  translated  into  the  language  in  which 


tho  game  is  written.  One  wQrr’  of  caution  is  in  order  at  this 
point.  The  nethod  used  to  generate  the  U(0,l)  numbers  de¬ 
pends  on  the  computer  having  a  43 -bit  word  length,  and  the 
method  must  be  revised  for  use  on  a  machine  with  a  different 
word  length. 

The  Control  hate  Corporation  1604  stored  program,  gen¬ 
eral  purpose  digital  computer  with  a  storage  capacity  of 
32,763  4° -bit  words  was  available  at  the  Naval  Postgraduate 
School  for  this  project. 
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2.1  *’ oner"  1  Fa  c’ :g ro* mH 

The  ourrose  of  this  rection  is  to  discuss  the  following 
question:  '  her,  a  generator  has  produced  a  sequence  of  ran¬ 
dom  numbers  and  r  is  desired  to  associate  then  with  a  parti¬ 
cular  distribution  function  F,  what  should  be  the  criteria 
for  deciding  on  toe  merits  of  toe  generator? 

For  illustrative  purposes  the  N(0, 1)  distribution  will 
freouentlv  be  referred  to  in  this  section,  although  most  of 
the  remarks  will  pertain  to  the  generation  of  any  sequence 
of  random  numbers. 

The  criteria  will  to  some  extent  depend  on  the  employ¬ 
ment  of  the  generator.  For  example,  statistical  sampling  ex¬ 
periments  for  estimating  the  parameters  of  mixed  populations 
require  vcrv  strict  accenta.nce  criteria  for  the  random  number 
generator.  The  employment  considered  in  this  paper  will  be 
nrimaridy  in  the  war  game  area. 

Tf  the  F  with  which  the  sequence  of  random  numbers  is 
to  he  associated  is  >’(0fl),  it  is  obvious  that  a  mean  near 
xero  and  a  variance  rear  one  must  be  demanded,  but  is  this 
sufficient'1  The  answer  is  enohe.t  1  ca  1  ly  no,  as  Figure  2 


i lluctrates . 


Figure  2 

e  Tensity  function  graphed  in  Figure  2  could  well  have  r 
near,  of  “cro  and  a  variance  of  one,  but  the  skew  to  the  left 
elinina**es  it  from  considerat ion . 

A  teat  of  the  sequence  of  n  vibers  by  computation  of  the 


first  three  central  nonents  gives  the  criteria  for  the  mean, 


variance  and  skew .  Is  this  suffiecient?  The  answer  is  defi¬ 
nitely  no  again.  Two  density  Sanctions  nay  have  the  sane 
values  for  the  first  three  central  moments  and  yet  have  quite 
different  values  for  the  fourt’  and  higher  central  nonents. 
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:qeakedness'T  or  '"flatness1 


of  a 


en- 


sitv  function.  \  ro  .igh  measure  oe 
a  a’ka'-1  fourt1'.  central  noser  t .  A 
tively  high  ner1  such  as  the  curve 
lonto’-urtie,  T. i  1  c  *-he  curve  in  Fi 
k';ripef1  :  s  called  nletykurf  ie.  \  d 
e,rcessinf  1^  nan1'®'1  nor  excessively 
tic'  ,  fo”  example  the  rornal  dis^r 


vuetcs is  is  the  stand- 
d- sttibution  having  a  re la¬ 
in  Figure  3a  is  called 
g  ire  3b  which  is  flat- 
istribution  which  is  neither 
flat  is  called  'hpsolur- 
ihution ,  see  111  . 
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Flatykurtic 


Leptokurtic 
Figure  2a  Figure  3b 

o  o 

Now  we  have  established  a  requirement  for  at  least  com¬ 
puting  the  first  four  central  moments  to  provide  data  for  de¬ 
ciding  if  a  sequence  of  numbers  can  be  regarded  as  a  sample 
from  a  desired  distribution,  F. 

At  this  point  the  experimenter  would  do  well  to  apply  a 
frequency  test  to  the  sequence  of  numbers  by  dividing  the 
theoretical  range  of  the  numbers  into  class  intervals  and 
counting  the  numbers  which  fall  into  each  class  interval. 
Since  the  theoretical  frequency  of  occurrence  of  numbers  in 
each  class  interval  is  known,  a  goodness-of-f it  test  like  the 
chi-square  test  may  be  applied  to  test  for  a  significant  dif¬ 
ference  between  sample  frequencies  and  observed  frequencies 
in  the  class  intervals. 

In  the  case  of  the  N(0,l)  distribution,  any  sample  con¬ 
sidered  to  have  been  drawn  at  random  should  have  an  approxi¬ 
mately  equal  number  of  positive  numbers  and  negative  numbers. 
A  count  of  positive  signs  thus  provides  the  data  for  another 


r: 


tes 

t.  Tif  occur 

re  nee  o  f  par i t ive 

signs  for  any 

distribution 

has 

the  binomial 

d  i  s  t  r  ib  u  t  ion  w  i  t h 

p  -  h,  if  the 

median  of 

the 

distribution 

is  at  aero.  dee 

feet ion  2.4. 

The  tests  dis cur> see1  up  to  this  point  were  concerned  with 
the  distribution  associated  with  the  generated  sequence  of 
random  numbers.  The  order  in  which  the  numbers  in  the  se¬ 
quence  are  generated  is  also  of  orimary  importance.  Tor  ex¬ 
ample,  in  the  general  case,  a  sample  of  say  10,000  numbers 
could  be  generated  which  would  pass  all  six  of  the  tests  for 
a  given  distribution  and  yet  have  been  produced  as  a  nonotonic 
sequence.  Olearly  the  war  gamer  -would  not  ordinarily  be  in¬ 
terested  in  tliis  sample. 


how  then  do  we  test  for  randomness,  in  contrast  to  test¬ 
ing  for  the  characteristics  of  the  distribution?  Since  we  do 
rot  want  the  numbers  in  the  sequence  to  have  a  predictable 
relationship  t:o  numbers  following  later  in  the  sequence,  a 
test  for  the  serial  correlation  of  the  numbers  (with  various 
la g s )  is  dc  o irablc . 

The  numbers  may  show  a  low  serial  correlation  and  yet 
co-' a  ‘  excess ivo’ "  -  runs  of  either  oositive  or  nesdr'v1 

»'  '•  *s. 

lumbers.  Tor  the  war  gamer  this  could  have  disastorous  ef¬ 
fects,  as.  his  rx-x  cted  values,  could  be  based  on  a  series  of 
’?c:  ion  -.oints  •  -V<ro  Ms  random  number  generator  is  rroduc- 


1: 


in.-;  a  run  of 
The  over-all 
be  player1  a 


all  positive  numbers ,  or  all  negative  numbers, 
effort  of  this  situation  is  that  the  game  must 
prohibitively  large  number  of  tines  to  obtain 


results  that  have  a  meaningful  average. 


Table  1. 
a ary  tests 
proper tl es 


bovo  general  testing  information  is  summarized  in 
Tt  is  to  be  emphasise.-3  that  these  tests  are  neces- 
,  but  are  not  sufficient  to  guarantee  the  desired 
,  even  when  administered  collectively. 
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n  explanation  of 

"he  meaning  given  to  ,  the  sample  site . 

The  multiplicative 

scheme  used  to  generate  **he  U CO,  1)  number 

s  used  in  the  gen- 

A 
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orators  in  th.is  thesis  has 

a.  period  of  2  ' 

numbers  and  pro- 
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’ace.;  the  odd  numbers  between  1  and  2 

These  numbers  are 

1  ' 


transformed  -r.t-j  i  i  i  ^rval  (0,1).  The  7J(0,1)  numbers  r re 
transformed  in  one -to -one  correspondence  to  numbers  of  another 
hist ribution,  so  a  cycle  in  the  generation  of  the  0(0,1)  num¬ 
bers  implies  a  cycle  of  the  sane  period  for  the  transformer’ 
numbers .  sample  rice  of  n  -  IOC  means  the  cirs  t  100  icun- 
bers  of  the  cycle  arm’  a  sample  sice  of  n  =  500  means  the  first 
500  numbers  of  the  cycle.  In  the  second  case  the  first  100 
numbers  a  re  refe^ed  as  the  first  part  of  the  sample  of  500 
numbers.  In  of  he**  words,  all  samples  start  with  the  first 
number  of  the  cycle  produced  by  the  uniform  generator. 

Oince  some  °,0Q0  billion  numbers  are  produced  before  re¬ 
peating,  an  euperimenfer  could  enter  this  cycle  at  any  ,3c- 
sire'-1  point  and  start  qeneratinq  numbers  which  suit  his  pur¬ 
poses.  The  tests  in  this  thesis  extend  only  to  the  firs*: 
10,000  numbers  of  the  cycle  because  of  the  restrictions-  of 
available  machine  time.  The  generation  of  10,000  normal  num¬ 
bers  is  ~<uite  rani.d  but  the  batterv  of  tests  aoelied  dras- 
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tically  increases  computer  time  required. 
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est  or  ,'omer,*s 
The  moment  tes-r.  are  constructed  from  the  definitions 
of  **he  first  four  central  sample  moments.  /-II  summations 
are  taber  on  1,  fo1*  •-  1,2, - ,r. 
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n,  through  n,  are  corouted  from  venerated  sample.  values  and 
are  consistent  estimates  of  the  theoretical  moments. 

Ml  moments  exist  for  the  normal,  exponential  and  chi- 
square  distributions,  and  the  theoretical  values  may  be  ob¬ 
tained  from  the  moment  generating  functions.  For  the  N(C,l) 
distribution  the  odd  moments  vanish  and  the  second  and  fourth 
moments  have  a  value  of  one  and  three,  respectively.  Compar¬ 
isons  of  the  first  four  sample  moments  with  their  theoretical 
values  re  made  for  all  four  random  number  generators  in  this 
nap or . 
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where  m  , m  and,  n  are  the  central  moments  defined  above, 


lq  and  Q>  are  called  the  coefficients  of  skew  and  hurtosis, 
1  "  2  ’ 
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£’v  di  5fe'*cnce  1:  s  *n  the  choice  of  too  class  intervals.  Tr 
the  first  case  the  -bscissa  is  divided  into  14  class  interval 
as  shown  in  Figure  4,  Twelve  of  the  intervals  are  of  equal 
leapt’  an.’  the  numbers  creator  than  three  arc  combine''1  into 
a  simla  class  and  the  numbers  less  than  minus  three  are  con- 
bin'*'-1  into  a  single  c1acs . 


Fie are  4 

Tor  the  second  ter4'  •'he  class  intervals  are  assigned 
equal  probability  of  occurrence  of  sample  values,  rathe"  than 
O'-ual  len.qf'h  -vibd-iv- siens .  The  class  intervals  are  chosen  as 
indicated  in  ’"inure  5. 
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"or  the  exponential  and  chi-square  distribution  goodness 
of- fir  tests,  ten  class  internals  with  equal  probability  were 
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and  tr-’o-s i  dr.-’  t-^sts  rcr  rignifi  csnce  at  the  0.03  and  0.01 
levels  of  significance  are  applied. 
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erial  Correlation  Test 

'"he  peri r l  correlation  coefficient  ir  a  measure  of  the 

relationship  oc  numbers  in  a  sequence  to  numbers  occurring 

later  in  “he  sequence.  For  example,  given  a  sequence  of  n 

numbers  ,’J  , - ’>  )  the  relationship  of  the  first  nurr.be 3 

12  n 

So  H'i rr,>  the  r'~oond  to  the  fourth,  the  third  to  the 

f  i  ft*',  r"r^  so  on  ir  called  serial  correlation,  lag  tv:o,  and 


is  ’of i.ner’  !  ■<7 : 


>v  'U.,U. 

1  ’  V 


o  *'VprU  *■  (t'arU  ; 


In  ~er  ■  1,  ruun:  or.  ',  j  ~  1,2, - ,n-k: 


n  - 


v  ' 

L  '  ^ 


i 


_ \  /  j .  _  _  i  ,  ■  i 

>'•-!<  /  .  i  (n-ib^l/  qJj 


V  i^r  ua 

i  r 

_ £_ 

’  Z_V 


l  I 


1  r  * 


ix  *  r  <  ■ v  %  .  /\ x 

Ji)  !  I  /  . UiA  C"-*n/_/U1v 


L 


M though  is  computation  formula  is  rather  involved, 


,-'a 

'J 


to  PC  IT  IAN  ^'o:r:rnr'~ .  It  w  irt  be 


u'-'-nr  v.\  Pt .  3 ,  box  re*  ■ 
'V  r  ipr:.  •  * 


1,  nr/  r 


un- 


"V  "~3  in  of  y  ■vn,*pff  c’nn  ^las  one  to  ninus  one,  with 
■plo  i  ’*'■•■  ic'o;  1  t.io .  It  i <•  Jet  tree1  to  hee^  the  absolute 


t  *r  ’  m  <“ 


of  *  1  o,'t  without  Ion-'’  tun  s  of  nos  it  ive  rnf  reiativ 


. n  n  r 


bun  Toot. 

~ue  toot  ^ascrll  e-1  >n  this  section.  will  only  be  noolie  ' 
to  iur-  ^  r  pvp::r*:or  by  .  „  ..  p  if  bj  S.  y  sit  10*15:1  .?  nr*  ~ 
i  o f  fMr  rep t*  nnulc  be  erril,;7  c^^lic?/  to  ' 71  nrv 


V 


>ee 


h 


-  cprUr.  p  of  ;n*“  ’on  M f" ^  y  i ;  numbers  a  certain  nun- 
bo;  of  rune  oc  xrUive  an/  negative  nunberr  will  occur  bv 


f  “T-r  co  . 


n  nv.  v^cs  ^enerr  tec’  t 


1  ^  v* 


alternate lv  nos  it  w  -e 


-i  ’  neyntive  with  no  runs  £  tea  ter  then  one  in  length  above  .  r 
loluw  '  -  c.  *ilr’  hrt  ’ly  sty  that  these  numbers  were  tan- 

•’or.  ,  an  t’ e  r~  ‘  '••il  ’  re  ‘-oo  yoo  ’ .  The  greatest  tv  tuber  of 


.nr  r  'O 


one ,  **he  ne^t  y tea test  of  1 anyth  **v 


.  r  r* 


;*>■'  .  Tn  a  'h’eir  setinle  the  runs  nay  be  counter’  enr? 
nonpar*?  J  ”?f-u  ;-nr  t-beo t  *'  ■>-  c  1  ■  >p 3  uftr  for  fe tern ininr-  s  i^ni r  l  - 


rant  f  feren -es . 


•  ■'  J,  Ly*-1  ■>>  Jr.  o'  the  University 


oT  Fieri  V  |  -  i  }  t’  r  ^02"''  - •("'  rvviber  of  positive  on"’  negative 

rur.?  o r  lnn-t!-  i  r r  h  n  numbers  4  r  cnnrowimatol": 


”  i.2, - ,r- 


'"ince  it  in  ^es ired  to  keep  the  expected  nunber  of  nr 
in  any  class  interval  greater  than  some  nunber,  say  10,  for 
-  poo  ’r.rir-of-c  ’  fccrt,  the  expected  numbers  of  runs  greater 
than  ^  certain  length  may  be  qrouoeO  info  a  single  class. 

The  numbr  r  jr  positive  arv’  negative  runs  of  length 

renter  than  or  equal  to  some  nunber  k  is  r.^roxima  tely : 

_r _ 

r 

a  v 


Let  ”  he  refine'!  bv  the  following  equation: 

~r  at  least  one  run  oc  length?  j  =  (X 


i-irrp  tT  rr“'  * 


r  suits  oc  the  tm-sts  performed  on  sequences  of  n.im- 
V err  generated  by  -p— y,  y-gyOTT:,  ’rjOGCN’  and  CHIG5K  are 
given  ‘  ’’’abler  2  -  \  ~t  should  be  noted  that  ^os  Corr.  and 
hog  "’orr.  in  T-d  1  es  2-5  refer  to  the  largest  positive  and 
largest  nggative  value?  of  serial  correlation  obtained  in 
test'-  or  lap  me  thr  :uqh  20. 

7ur  the  normal  generators  in  Tables  2  and  3,  C’lIC'Tll 
refers  to  a  fre*1  lencv  test  with  equal  class  intervals  and. 

1~  r»er'.**cs  of  f\-  ci,  an  ’  0”Ir'*n2  refers  to  a  frequency  test 
with  equal  expected  frequencies  in  class  intervals  and  nine 
decrees  of  ^reedoi  .  The  theoretical  values  of  chi-square  are 
the  valuer  above  which  r1  r  tost  results  are  significant  at 
the  ,05  level.  7CTt77N  and  M0TroUK  both  passed  the  goodness - 
of-~it  *"  ■  ror  run-'  *r  sr,T',lc,s  of  rizc  1C00  and  greater  at 
the  ,05  level  c r  significance  as  indicated  in  Table  °,  arid 

.os 

as  define’  'v  "lection  2. 

-s  00 "O’  tr.ils  to  pass  the  frequency  tests  for  sample 

rice  o c  5000  anJ  l^^OO  at  either  the  .05  or  .01  rignificanc 
levels,  the  frtguency  count  for  the  ten  class  intervals  for 
cannier  of  run  1000,  5000  and  10,000  are  compared  in  Table  6 


there  were  no  runs  longer  than  K  ,  where  ~  3. 3  Clog  n  1 


intervals  are 


.‘.lthoug1*  the  perceritag(er  of  numb.-  as  in  class 
similar,  the  fit  becomes  poorer  as  the  sample  size  increases 
due  to  th.e  square  difference  in  the  numerator  of  the  chi- 
s  cur  re  statistic.  For  example,  120  x  120  ~  14,400  is  100 
timer  as  qreat  as  144,  while  10,000  (the  denominator)  is  only 
ten  times  creator  than  1000.  Mso  it  is  noted  that  a  sample 
of  size  100  fares  very  badly  in  most  tests  performed  on  se¬ 
quences  of  numbers  produced  by  T'.rOGFN.  The  magnitude  of  ex¬ 
ponential  numbers  is  very  sensitive  to  the  magnitude  of  the 
uniform  numbers  from  which  t’^ey  are  transformed.  This  is  true 
of  harsaglia’s  method  £oj  and  a  more  we 11 -known  method,  i.e., 
taking  the  logarithm  of  U ( 0 , 1 )  numbers. 

The  last:  col  rra  of  Table  5  (C’lIOFi!)  gives  the  values  of 
th.e  chi-s.qjare  goo<’nr  ss-of-f  it  statistic  using  10  classes. 

For  nine  degrees  of  freedom  th.e  .  n5th  and  . onth  percentile 


points  of  the  c^i- square  distribution  are  16.0  and  21.7  re¬ 


spectively.  Thus,  significant  results  at  the  57  level  -were 
obtained  for  r  *  °^0  and  U  -  ?. ,4,5  and  15.  In  order  to  in¬ 
vestigate  this  further  a  chi-square  analysis  was  done  for 
sarnies  of  size  50'd  and  1000  (Table  7)  .  It  should  be  noted 
that  fit  does  not  necessarily  improve  with  sample  size.  For 
all  degrees  of  freedom  and  sample  sizes  considered,  CHOFF 
passes  the  test  of  fit  at  the  .01  level  of  significance. 


r\  r 


'ro  curt’r  •  '■‘-s,  lo^e  the  properties  of  the  TIIG-N  numbers , 
'.'ho  fi  rst  feu  *  lomen'T  Here  computed  but  not  tabled  for  p am¬ 
ple  i  cf  size  l"'0,  500,  10^0  anr-  5000  with  five  degrees  of 
freedom.  The  theoretical  values  of  the  first  four  moments 
ere  ,1'*,  4-0  and  500,  respectively,  as  commuted  from  the 
moment  generating  function.  The  values  of  the  first  and 
second  •lomentr  v/ere  reasonably  close  to  the  theoretical  val¬ 
ues,  but  the  values  of  the  third  moments  were  quite  low  for 
all  sample  si.es.  The  value  of  the  fourth  moment  was  low  for 
a  sample  size  of  50'"',  indicating  a  possible  ’’flat'  curve  for 
the  >ns,?tv. 

"one  of  the  raw  data  test  results  have  been  included  in 
""abler  2-~,  as  they  are  likely  to  be  of  interest  to  experi¬ 
menters.  Table  °  is  a  summary  of  results  of  tests  for  n  =  1000 
for  '"Ticyy  rrv’  n  -  1^,000  for  all  other  generators.  The  terms 
G  ",  ”.’.11  end  rC”n  in  Table  °  are  used  in  an  intuitive  and, 
relative  sense  rather  than  as  any  absolute  standard.  GCCT' 
generally  implies  that  the  theoretical  and  test  values  are  not 
significantly  different  at  the  .05  level  and  no  undesirable 
characteristics  are  erparent.  FOGG  implies  significant  dif¬ 
ferences  at  the  ,01  level  or  sufficient  deviations  from  theor¬ 
etic  G  v •■.lacs  to  take  *:he  generator  suspect  for  some  applica¬ 
tions.  F.MG  implies,  a  condition  somewhere  in  between  the  two 
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Table  4 


37.7 


n  - 1 00 

n=500 

n=100C 

n-5000 

n- 10000 

Theor . 

”  -can 

o  qn 

i .  020 

1.021 

? 

• 

1.002 

1 . 000 

Van . 

.6?6 

1.04c 

.  071 

o"2 

1.036  ; 

1 .  no" 

1  onenf 

.COO 

l.""2 

1 . 5"6 

1  09  s 
♦  •  *—  — 

2.160 

2.000 

4th  ’  rornent 

4.620 

-5  .£/ £ 

6.150 

3.1"! 

13.061 

" .  000 

Chi-sqr 

13.0 

"  .72 

".70 

22. 5Q 

33.70 

16.  "0 

La rgest 

3 .0  7 

7.10 

7.13 

3.32 

10.57 

"os  Corr 

.215 

.107 

.04? 

.035 

.017 

Teg  Corr 

-  .  2  c  7 

- .  07? 

-.051 

-.02° 

-.027 

Table  5 

-  CHICOT  ( n=200) 

•9-7  f  '  \ 

•  V.  L.  / 

Mean 

7a  r 

"os Corr 

NegCorr 

Largest 

Chi-sqr 

1 

1. 1°7 

!  2.352 

.072 

-.ll5 

7.04 

3.42 

r\ 
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2.153 

;  ? .  "77 

.111 

-.115 

".35 

7.30 

q  0  r>o 

•  -  1  *■- 

r  .ooi 

.132 

-.103 

11.12 

13.34 

/. 
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7.071 

.14" 

-.136 

11.5" 

1"  .07 
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15.71 
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n=5000 

n= 10000 
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The  teste  have  Semens t rated  that  random  numbers  nay  be 
generated  that  behave  when  tested  like  numbers  from  a  normal 
exponential  or  chi- square  distribution.  It  is  apparent,  how 
ever,  that  the  behavior  of  these  numbers  depends  heavily  on 
the  multiplicative  scheme  used  to  generate  the  TJ(C,1)  random 
numbers  from  which  they  were  transformed .  home  of  the  gen¬ 
erating  schemes  discussed  in  this  thesis  are  theoretically 
exact  so  that  tue  tests  described  in  effect  provide  addition 
al  tests  of  the  performance  of  the  random.  U(0,l)  generator 
that  is  an  integral  ;  art  of  NCTfGdN,  NOISK'JM,  TT.FCG3N  and 
C^IGd'T.  for  generation  and  testing  of  random 

number^ . 

In  general,  the  test  results  of  Section  ?  indicate  that 
b'T'.G'Td  rv' . IC  TT'  east  be  used  with  caution  for  verv  small 


samoies  and  N 


^  v  must  be  used  with  caution  for  large  sam¬ 


ples.  The  chi-square  generator  was  obtained  by  two  transfer 
ma •"buns  -pd  should  be  vrefully  examined  for  the  sample  sice 
and  denr-ecs  cr  freedom  required,  as  the  results  are  not  con¬ 
sistent  throw  .houfc.  further  testing  is  required  for  the 
latter  and  will  require  rather  extensive  machine  time  if 
large  samnle <•  and  <?pveral.  numbers  of  degrees  of  freedom 


°1 


r<?  cor..'  i 


1.:1  '  r  .  ,  Or  -rioont')  which  uses  a  “rent  many  rnr - 

’~m  numbers  s’  aul-1  ’  we  the  capability  of  testing  snnples  of 
these  -.up.be rr  at  desired  inbei.vr.ls  to  ensure  that  the  number 
gen*- ra  tor  has  nob  r°’l<“n  into  son  sort  of  trap  such  as  find¬ 
ing  a  aero  in  a  nultioiicative  scheme.  This,  of  course,  is 


ucroly  an  extension  of  the  general  rule  of  not  trusting  the 
machine  output  answers  before  submitting  the  noeel  to  a  test 
pro gran  with  ’-.now  answers.  In  any  extensive  program  the 
arithmetic  scheme ~  pay  '  e  giving  answers  to  questions  that 
wore  really  ashed,  n  "  not  to  questions  the  programmer  thought 
h-'  as"  od. 


is  an  inch  lental  observation,  it  is  believed  that  the 
logical  sequence  of  learning  program  techniques  is  to  start 
with  ‘‘he  machine  language  and  the  fundamental  machine  instruc¬ 
tions,  'ogre^°  bo  •  ,s.  assembler  and  finally  to  a  compiler. 

..von  tb'O’.r  h  a  Icr  language  such  as  is  advertised 


computer  <?  r-crience  necessary the  programmer  who 


does  no.  un  n e  - r t a n  1 


‘*1'c  basic  machine 


instructions  vrll  find 


V-d  u y gi n g  M.«*  n ro  -.re •  ■  a  nen civ  impossible  tas-'.  This  is 
apparently  not  a.  ♦'ter  of  eneral  agreement. 

lince  random  r.vbers  have  been  generated  by  several 
me.  oth^v  *-han  a  *?  ‘  ’.me  tic  schemes,  including  generation  by 


.1  J\  ..5  1  «.i:  '  ■  1  .t  led  devices  i  ,  i**  would  seen  reason¬ 

able  to  make  a  c-  n.  .ricon,  b-zo  or  three  of  the  "best’'  pub¬ 
lished  table?  of  random  numbers  could  be  typed  onto  cards  and 
inserteJ  into  machine  memory  for  testing  by  the  same  battery 
of  tests  that  r  ri  h,  MCBMBUM,  BbIG'dN  and  uTOfrih  were  sub¬ 
jected  to.  It  is  real 'red  that  typing  10,000  IBM  cards  is 


me. .. !  *  as 


T_-p  s on o  c.ci  c  o  °* 


ren- 


^  '’ecks  of  car  'c,  mar  be  available 


The  iterative,  multiplicative  algorithm  used  to  gener¬ 
ate  the  ’r(A,  0  ce  nenc"  delivers  a  long  cycle  of  numbers  vritV 
out  reporting  i  nd*  vidua.  1  numbers.  Blochs  of  these  number’s 
within  th"'  cycle  re  suite  lihely  to  have  undesir cable  char¬ 
acteristics.  The  cycl"'  can  be  entered  at  any  point  by  in¬ 
sert*  nr  "ho  Vs  hr''  ’'striding  number1’  in  the  algorithm.  If 
small  bleed's  of  numbers  were  tested,  those  blocks  showing 
no ~ r  f’iir:  ctari- !:  les  could  be  dropped  from  the  cycle  by  test¬ 
ing  for  the  critical  priming  numbers.  There  is  a  definite 
d,- rimer  involved  this  procedure .  The  drooping  of  short 

ilncl?  of  numbers  '-u.ng  poor  characteristics  may  improve 
c  v .  1 1  samples  and  ’a  the  characteristics  of  large  sam¬ 

ples.  7’  is  matter  has  apparently  not  been  discussed  in  the 
literature . 
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generating  exponential  RANDOM 
VARIABLES 

Ana Is  of  Mathematical  Statistics 
’olume  22,  Number  3,  September,  1061 


2 fferinp  a  ’evice  for  producing  exponential  random  vari¬ 
ables  by  performing  discriminations  on  the  relative  mag¬ 
nitudes  of  uniform  (0,1)  random  variables. 


3.  Narsaglia,  G. 


STRESSING  A  RANDOM  VARIABLE 
IN  TEA'S  OF  UNIFORM  RANDOM 
VARIABLES 

Anals  of  Mathematical  Statistics 
Volume  32,  Number  3,  September,  1°61 


Suggestion  for  expressing  a  distribution  function  as  a 
rn  Sure  of  suitably  chosen  distribution  functions  .... 
choosing  a  distribution  function  which  is  close  to  the 
original  and  using  it  most  of  the  time,  applying  the 
correction  only  infrequently. 


Lytel,  .  \,  Jr.  A  OESGRIITICN  OF  TIES  GENERATION 

AND  TESTING  OF  A  SET  OF  RANDOM 
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Symposium  on  Monte  Carlo  Methods 
University  of  Florida 
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Generation  of  normal  deviates  employing  numerical  methods 
and  details  of  tests  for  normality  and  randomness. 
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A  detailed  discussion  of  randomness  and  tests  for 


randomness . 
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CRSA  Journal 
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THE  MONTE  CARLO  METHOD 
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Volume  6,  Number  4,  December,  1953 

A  general  discussion  covering  broad  areas.  A  very  long 
bibliography  is  appended. 


3.  Mood,  A.  M. 

INTRODUCTION  TO  THE  THEORY  OF 
STATISTICS 

McGraw-Hill 

First  Edition  1950 

A  standard  textbook. 
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DIGITAL  COMPUTERS 

U.3.  Naval  Postgraduate  School 
Thesis,  1°62 
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Third  Edition,  1°47 


.1  comprehensive  teutbook,  intended  to  be  a  book  on 
statistics,  not  on  statistical  arithmetic. 
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'endall, 


THE  ADVANCED  THEORY  CF  STATISTICS 
Volume  II,  Chapters  17  through  30 
Hafner  Publishing  Co.,  New  York 
Third  Edition,  Third  Impression, 
1^59 


A  continuation  and  expansion  of  Volume  I  with  a  biblio¬ 
graphy  of  more  than  1500  titles.  The  two  volumes  com¬ 
prise  a  treatise  on  statistics. 


13.  BowLer,  A.  H. 
and 

Liebernrn ,  G.  J. 


ENG INHERING  STATIST ICS 
""’rent  i  ce  -Ha  1 1 ,  Inc . 

Fourth  ^rinting,  May,  1961 


Intended  as  a  tent  for  a  first  course  in  statistics  for 
students  in  engineering  and  the  physical  sciences. 


14.  RAND  Corporation 
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\s  the  title  indicates. 
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with  a  calculus  background.  Oriented  toward  engineer¬ 
ing  with  nary  anplications . 


The  purpose  of  this*  appendix  is  to  discuss  in  more  de¬ 
tail  the  two  methods  (NOT 'SIN  an d  NBTtSUN)  of  generating 
random  *’(0,1)  numbers  introduced  in  Section  2. 


it  Xf 


•puner1,  as  has  been  rone  throughout  this  thesis, 


that  r.  method  to  generate  uniform  random  numbers  is  available, 
0  transformation  of  uniform  random  numbers  to  normal  random 
numbers  will  now  be  considered .  Of  the  several  existing 


methods  to  accomplish  this,  the  method  suggested  by  Box  and 

'duller  1 1,  was  selected  for  accuracy  and  integrity  in  the 

tails  of  the  distribution,  as  war  gamers  and  others  can  be 

-ui  to  interested  in  "rare  events . 

NCnSSN:  Let  11  .U  be  independent  random  variables  from 

-  1’  2 

the  uniform  density  function  on  the  interval  (0,1).  Consider 
the  random  variables: 


(-2  log  7J  )  Cos  2  TrU 
e  1  2 


(1) 


X 


t, 

(-2  log  U  )  ’  Sin  2Tr’J 
"el  2 


Then 


(X, ,X  )  are  a  pair  of  independent  random  variables  from  the 
i5  2 

same  normal  distribution.  Notice  that  the  radical  is  always 


positive  since  1. 


Just  if icnti on : 


Solving  (1)  for  the  inverse  relation- 


n  i: 


A  «-  * 


n n  vfnhout  difficultly 


-  e.o  '-(::;  i-  x*)/2 

I  -  X  /. 


-  ( 1  /?. 7T) arctan (X  /X  ) 

2  1 


rr*  1  t  i  •  r* 

10  MCO:  XcOn  of  i  V 


(1/270  c'-.'-.  [.(•<’  "‘)/2 


,  ,  jwith  respect  to(X,  ,X^j  is  found  Co  be 

and  the  joint  density  function  of 
U,,’J0  is  1,  so  that  the  joint  density  function  of  X,  ,X  is: 

2  ..2, 


C.  f  V  ‘ 

‘  V 


0/2  TDexo  [-<X  +  XO/2 


(1/2H  ?exo  f-X^/?  •  (1/27T)  2exn  f-Xr/2 


f(x  ).  f(x0) 


•'rtrbl ' r!'?n  f  lat  Xt  and  X  are  normal  (0,0  and  independent. 

ixocepp-' or  (1)  is  analytically  exact  and  the  character¬ 
istics  of  the  n.urb  rs  produced  cire  distorted  from  the  ideal 
only  by  e  pseudo  -radon  uniform  numbers  used  as  input  and 
hv  th  -  la  chine  :a  1  a  ■  ■  a  1 1  ons ,  inc  lud  inp  the  square  root ,  lop , 
pine  and  eorirv  'outj-'ap.  Xxpected  accuracy  is  13  decimal 
dip-*  *-«•  'ti  the  O' >3  If  04  70'm.\NT  routines.  It  is  hoped  and  ex¬ 
pected  dnt  connu*’'-tional  round-off  errors  will  be  random. 

**d  v  v-Tn  > ,  « r  -  -  ,P  users  may  not  be  interested  in  rare 

events  but  ir  around  the  mean  we  next  select  for 


to?  fir  met’ o'  1  a  red  on  the  Central  Limit  Theorem.  The 

■distribution  of  one  of  independent  random  variables  from 
symmetric  distributions  approaches  the  normal  distribution 
guite  rapidly.  It  is  noted  that  50  numbers,  each  composed 
of  the  sum  of  five  random  dibits,  gives  a  strikingly  normal 
appearance  when  plotted  in  a  histogram. 

Cince  the  variance  of  the  U(0,1)  distribution  is  1/12 
and  variances  of  uniform  random  variables  are  additive  under 
convolution  it  is  convenient  to  select  12  as  the  number  of 
uniform  random  variables  whose  sum  will  approximate  a  normal 
random  variable,  beans  of  uniform  variables  are  also  addi¬ 
tive  so  that  it  remains  to  subtract  the  constant  six  from  the 
sums  of  12  independent  11(0,1)  random  variables  to  approximate 
a  normal  (0,1)  distribution. 

This  process  truncates  the  distribution  so  that  -6  =  x  =  6. 
1  low  much  is  lost  by  this  truncation  can  be  estimated  by  the 
fact  that  normal  tables  with  4-place  significance  have  posi¬ 
tive  probability  within  the  limits  -4.2.6=  x  =4.26. 

There  is  a  cast1  for  the  truncated  normal  distribution 
in  that  a  model  is  useful  when  it  can  be  realistically  ap¬ 
plied  to  a  real  world  situation.  Consider  the  height  of  men 
of  a  civen  race  as  a  random  variable,  normally  distributed. 

"or  use  the  distribution  is  truncated  in  that  the  smallest 

'  r 


'  :  hr  tr  c  t.  ’  1  ter  then  one  foot  one’  tuo  greatest 

height  lest  than  ten  feet.  Definite  bonne’s  can  be  set  on 
many  errors  of  nea  ur orient  which  are  considered  normally  ’is- 
tributed.  hnpl :  ceti on?  of  the  theoretical  normal  distribu¬ 
ted  are  so  frequently  truncated  in  the  real  world  that  it 
seems  inconsistent  to  reject  a  manually  generated  sample  from 
a  normal  population  if  the  sample  exhibits  the  properties  of 
the  theoretical  distribution  between  the  limits  of  usable 
values . 


APPENDIX  B 


EXPONENTIAL  RANDOM  NUMBERS 

The  exponential  distribution  figures  prominently  in 
particle  or  radiation  studies,  reliability,  life  testing  and 
like  areas  which  can  be  of  interest  to  persons  using  high 
speed  computers  and  monte  carlo  techniques.  A  power  series 
expansion  to  compute  the  logarithm  of  a  uniform  random  vari¬ 
able  may  be  used,  to  generate  exponential  random  variables, 
but  a  more  rapid  method  is  desired. 

0.  Marsaglia  of  the  Boeing  Scientific  Research  Labora¬ 
tories  offers  a  simoler  .device  for  oroducing  exponential 
random  variables  by  performing  discriminations  on  the  rela¬ 
tive  magnitudes  of  uniform  (0,1)  random  variables.  Bee  '2  . 

The  idea  is  to  choose  the  minimum  of  a  random  number  of 
uniform  random  variables,  then  add  a  random  integer - say. 


let  n  and  m 

be  random 

integers 

according 

to  the  following 

schedule : 

Value  o f . n 

.  "rob. 

Total  Value  of  m 

.  .... 

Prob . 

Total 

1 

.53  ! 

1 

.50 

i 

0 

.  63 

.63 

2 

.20 

.  °7 

1 

.23  ! 

.86 

1 

J 

.10 

.07 

2 

.00 

nq 
*  '  ^ 

4 

.02 

.  °° 

3 

.03 

.08 
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/  /-i 


rv  '>r>  if  T'.  . 3  r  a  po'-'Mcrvce  of  independent  un: 

f  -rnfom  vr--s .  c  on  ('T,!),  the  rmr’on  vatiablr- 


■  ■  :-j  ,m  , 

i  ^ 


,’J  ) 
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'v  s  the  oxoopo  3 ril  attribution. 


’nl'j' 


ien 


d  i  J  ;  r i  a  '  :  I  t  n  be  a  re., don  ■•variable  tabirv; 

•f  1, r'f’  ~  robrbilities  p  ,p  , . 

12  3 

-  -  oi  (h  ,  j  , . >1 : 

1  2  n 

tb**  dir  t  ibati  oc  y  is,  for  0  =  9  =  1, 


1-ryCl-?'  -  ■> 


;v  -tic-lb  •,  if  r  -  1/Cc-l)  =  .5°l^7C:7 


.  .  .  one 


c/  -  •  > 


ir:  r . 


*“*  «n  '  ■ 


valuer  ^,1,2,  ... 


re(l-o  )  ,  0^0=11 

T->eo r •■;-.! :  Tf  e  -  1/ic-l)  and  if  “he  random  var¬ 
iable  a  tahes  *.v  1  ier  1,2,2,  ...  with  probc.bili- 
5  ■  r  c ,  c  ,  •  ,  ...  <ir,!  if,  independently, 

-  ran* 'em  vr.n-  ’ 

;oK  I'rb  •?  l/'ca),  l/(ce”),  l/(ce‘  '  ,  ..., 

•run  tv  e  ra.rvi  n  v*  "able 

•  n  +  -rni]  '  U  N 

1  • .  n 

’  <-  th<?  ev  cr^r*-4^  1i  r t  ribution 

'  2  .  ;  -  1-e"  '  °  -  ' 

>  —  *  • 

~roef  :  a  n-’ter  oc  verification - if  v  =  1 
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ait enpix  c 


:hi  square  pantxt:  _  huh  hers 

Let  ...  , x.^.  be  y  independent  random  variables 

normally  distributed,  each  with  zero  mean  and  unit  variance. 
.  2 

Let  2d  equal  the  sum  of  the  squares  of  these  \J  random 

2  2 
variables,  i.e.,  Y‘  =  x*  +  x^  t-  . . .  +  .  X  is  also 

a  random  variable  because  it  is  a  function  of  random  vari¬ 
ables.  The  density  function  of  the  chi-square  random  vari¬ 
able  is  written  as 


1X1 


*i  = 


.  ife~)  .x 

(XT  X 


2. 

X  2  o 


otnerwise 


All  x's  must  have  zero  mean  and  unit  variance.  If  they  are 
independent  normal  ( //  ,  .X)  numbers,  the  quantities 


-  *  i.2, - ,1/ 


do  have  a  normal  distribution,  each  with  zero  mean  and  unit 
variance.  Hence,  --urn;  iny  on  i,  for  i  -  1,2, - ,  'j 


X' 


=  eh:  =Ei^-^r/x 


has  a  chi-square  distribution  with  'j  decrees  of  freedom. 

An  example  of  such  a  random  variable  is  as  follows: 

A  missile  is  sent  toward  a  target.  If  the  range  and  de¬ 
flection  errors  of  the  missile  are  independent  normally 
distributed  random  variables  each  with  zero  mean  and  equal 
variances,  the  squared  distance  between  the  explosion  and 
the  target,  divided  by  the  variance,  has  a  chi-square  dis¬ 
tribution  with  two  degrees  of  freedom.  This  can  be  easily 
extended  to  three  dimensions. 

A  subroutine  available  to  a  war  gamer  to  supply  inde- 

2 

nendent  numbers  with  arbitrary  degrees  of  freedom  thus 


can  Tiave  immediate  aonlication. 


A!  i  no  i 


Following  is  the  Por-Nuller  method  of  generating  pair? 
of  N(rgl)  numbers  from  ’-'airs  of  0(0,1)  numbers,  programmed 
in  t^e  Control  nata  Corporation  1^04  FORTRAN  language. 

The  program  rr'  written  merely  computes  100  numbers 
and  stores  them  in  an  array  called  ''TAB”.  N  is  the  sample 
size  and  V  must  always,  be  one-half  the  value  of  N.  The  di¬ 
mension  of  TAB  must  be  at  least  the  value  of  N.  The  numbers 
that  the  program  stores  in  TAB  are  in  floating  point  format. 


"T 'NNFIQN  10  ( 2)  , TAB  (  100)" 

!  lASK-AOOOCO^OOOOOOnoOB 
”12-2.*? .  1A15''2*5 
UNIT---'7  .**22  . 

TON  TO  -  JNTT 
T”(2)-l 

M=10O 

T  ?0  N=  1 , 50 

TVI2(1)  ,  INTI (2)  , IT’.M ( TO)  ,NUI(IUNIT)  ,BCL(:iArK)  ,STA2(IU)  , 
NUT (TUN IT) , 

C  CL  (’TAB)  . 

CTA1(T0) . 

01-TU(  1) 

O TAJ  1/2. **47 
O2--T0(2) 

02-02/2 .**47 

nloo=l*c~0  ./or, 

A  -mo _ 7-  TO  A.TTO 

'  TV  TO _ prwn/  A  no\ 

JU*  /_  -  )ih  \  -  -  .  i , 

n  *  ry  _  n  r»  rr *■  ^  %> 

"*  •  “  »  V..  J  i.  V  V  J 

v  T 

■  1=  roT*cco2 

il - V'  V.  X  1  il  .( 

r-?*' ' 


f  *7 
•  / 


?o 


L  -1 

tab(D=  :2 

TAB(L)=  :i 
CCCITIUUK 


The  TYl  lfn4  nrogram  for  generating  N(C,l)  numbers  from 
the  sums  of  12  uniform  numbers  also  stores  M  numbers  in  ''TAB". 


rR'sRR A' f  NOR 
or  KINS  ION  TAB (100) 

N=100 

MA  S  K= 4 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 B 
UNIT=2.**23+3. 

IUNIT=UNIT 
VJ- 1 

or  702  t=i,:: 

BTC 0=0 

00  701  ”=1,12 

LDA( TU)  'UI  (  IUNIT)  ,  SCLC  'ASIO  ,  STA(  IU)  . 

:iui=iu 

•:iui='-:iui/2.— 47 

701  3T0?«.= OTOK+ ' :  IU  1 

rr»  ▼')  e>  rv>  r*\ 

Jiv  A=.'iv-V-  •  * 

702  T/.B(I)  =  ST0K 

The  chi-square  generator  has  tv?o  parameters,  the  size 
of  sample  N  and  degrees  of  freedom  NU. 

m  ^  f  rsi  r  -r  r\  T 

-  v*.  ^  Vt  i.  .  -  1  0“  4.S 

^riSNSlON  TAB  (IOC) 

MASK=40000000000000003 
Ul\7n=2.  — 23  ‘r? . 

NU=  5 
N=  100 
IUNIT=UNIT 
I1J=1 

o:  °C3  i=i,k 
ITOTlsO 

OQ  302  TT=1  UU 
"TO 3-0 

oc  301  !'=1,12 

LPA  (  TU)  Til  (  TUN  IT)  ,  3CL(:  CASK)  ,  CTA(  IU)  . 

kiui=iu 


4.2 


rH 


i ; ;  i  -  -  1 


T' 

n  1  _ 


J.  ~  1 


-  0? 

nor 


x  th  ,T\?  7 


T‘.B(I)r.;:Tr'?vl 


/V  -vj  i.  s 


rt'.e  exponential  ;encrator  ’las  th®  ainple  parameter  N. 


JL  ^  J  .  v- 


n i; ' xt j i c n  tax ( ’.o°)  ,tt: C?o) 
:-'A'?TC=20000000000000003 
!  u\CX2=Wr0O'VT00000000F 

T’.=  2 . 71Xr'lr'?0/rr'° 
jNIT=2 . **23 f 0 . 

t:=ioo 

•^T  t\T  Ym  t  y*  y 

L  *  »  J  1  —  J  s 

c  r  -i . / ( ' : - 1  p 
ir=i 

X  1/-3  Lssl.K 


LDA(TU) , 

:rJT(iuNi't) 

'■^LC'x::2) 

r>rr-.  A  /  TT  v  N 

*„i!  xU ; 

.x'll' 

'.xcxxio 

•*-*  *  *  r»  t  > 

N  *  ‘  ■  *•  ' 


•  ””=1 
iV  XT 

•X7/”T 


T 


N  i  r  *»  o  r  pc 
/  •'  -  >  1  5 


•"*  ~  ~  i  *?  / 

:;v  (r.i) 

■'"lO-.'NTT' 
X.L(”  VX’X 

"TprO 
'  V(n) 

*  ~'vp  ''  -  »  ?~\ 


-.r-v) 

°TA  CO 
i . /cx 
H=0- 


137 

XT/g 

T  T__T  T  , 

i  i — .  1  r  ' 

Tn/n  T  T  v  1  o 

ir  Ji-A,  1  ' 

136 

•J  l—  ...  ‘  i  # 

C,c  mC  l  '5  7 

13° 

L?A(:  i:: ) 

'■»  a  *  t  /  *5  on'. 

n,J  ;; 

:ni?(i) 

13° 1  LCA(TU> 

mui'iu  lit' 

3 CL  'r  ACL?' 

CTA( IU) 

A  33  (11) 

a^(:  r.cr) 
f/j><  mac::) 
cta2  (t;c  r ' 

1  ^  fj  TOT’-O  / 

A  WJ  .  A  \  ■  »/ 

CLJ(lc-l) 

x  141  r-2,  !':•■:• 

T7(T’Tr(i)-T,::r(:0)  i4i,i4i, 142 
142  T'lrCl^TT'X'') 

141  ccntiacj': 

14?  ”*A3(l)=t  ::~(i)+’c: 

v' o  CCC  KL'  i- : ah  xi Cor  test  urograms  written  for  use  in 
this  thesis  are  available  in  7"  IT’  AM  language  in  the  Computer 
Center  of  the  ”,  Laval  "ostgra^uate  School,  Monterey,  Cali¬ 
fornia  . 


t* 


